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IS CLAIMED IS: 

1. A method for modeling the behavior of a data channel the method 
comprising: 

determining a sequence of data input to the data channel; 
using at least part of the sequence of data input to the data channel as an index 
to a channel model value; 

sampling the data after it has passed through the channel to produce a sampled 

value; 

comparing the channel model value with the sampled value; and 
adjusting the channel model value based on the results of the comparison 
between the channel model value and the sampled value. 

2. A method as in claim 1 wherein determining a sequence of data input to 
the data channel comprises determining the last N bits input to the channel. 

3. A method as in claim 2, where N = 5. 

4. A method as in claim 1 wherein the sampling of the data after it has 
passed through the channel to produce a sampled value comprises producing a real 
number representing the sampled value. 

5. A method as in claim 1 , wherein adjusting the channel model value further 
comprises adjusting the channel model value according to an LMS (Least Means 
Squared) algorithm. 
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6. A method as in claim 1 wherein adjusting the channel model value further 
comprises adjusting the channel model value until it converges. 

7. A method as in claim 6 further comprising converting the look up table into 
Volterra Kernels. 



8. A method as in claim 7 further comprising converting the look up table into 
Volterra Kernels using a Hadamard transform. 



9. A method as in claim 7 further comprising adjusting the Volterra Kernels 
based on the results of the comparison between the channel model value and the 
sampled value. 



20 10. A method as in claim 9 further comprising eliminating the insignificant 

Volterra Kernels. 

11. A method for modeling the behavior of a data channel the method 
25 comprising: 

determining a sequence of data input to the data channel; 

determining a Volterra Series representation of the channel; 

accepting at least part of the sequence of data input to the data into the Volterra 

30 

series representation of the channel to produce a channel model value; 

sampling the data after it has passed through the channel to produce a sampled 

value; 

comparing the channel model value with the sampled value; and 
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adjusting the channel model value based on the results of the comparison 
between the channel model value with the sampled value. 

5 

12. A method as in claim 11 wherein determining a Volterra Series 
representation of the channel comprises: 

accepting a most recent value of the sequence of data input to the data channel; 

10 

accepting the most recent value of the sequence of data input to the data 
channel into a first FIR (Finite Impulse Response) filter; 

accepting a product of the most recent value of the sequence of data input to 
the data channel and a second most recent value of the sequence of data input to the 
data channel into a second FIR; and 

summing an output of the first FIR and output of the second FIR to form the 
channel model value. 

20 

13. A method as in claim 11 wherein determining a Volterra Series 
representation of the channel comprises: 

accepting a most recent value of the sequence of data input to the data channel; 
25 accepting the most recent value of the sequence of data input to the data 

channel into a first FIR filter; 

accepting a product of the most recent value of the sequence of data input to 
the data channel and the second most recent value of the sequence of data input to the 

30 

data channel into a second FIR; 

accepting a product of the most recent value of the sequence of data input to 
the data channel and a third most recent value of the sequence of data input to the data 
channel into a third FIR; and 

35 
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summing an output of the first FIR and output of the second FIR and output of 
the third FIR to form the channel model value. 

5 

14. A method as in claim 11 wherein determining a Volterra Series 
representation of the channel comprises: 

accepting a most recent value of the sequence of data input to the data channel; 

1 0 

accepting the most recent value of the sequence of data input to the data 
channel into a first FIR filter; 

accepting a product of the most recent value of the sequence of data input to 
the data channel and the second most recent value of the sequence of data input to the 
data channel into a second FIR; 

accepting a product of the most recent value of the sequence of data input to 
the data channel and a third most recent value of the sequence of data input to the data 
20 channel into a third FIR; 

accepting a product, said product being the most recent value of the sequence 
of data input to the data channel and the two next most recent data input, into a fourth 
FIR; and 

25 summing an output of the first FIR and output of the second FIR and output of 

the third FIR and output of the fourth FIR to form the channel model value. 

30 

15. A method as in claim 11 wherein the difference between the channel 
model value and the output of the channel is used to update all the FIRs. 

35 
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16. A method as in claim 12 wherein the difference between the channel 
model value and the output of the channel is used to update all the FIRs. 

5 

17. A method as in claim 13 wherein the difference between the channel 
model value and the output of the channel is used to update all the FIRs. 

1 0 

18. A method as in claim 14 wherein the difference between the channel 
model value and the output of the channel is used to update all the FIRs. 

19. A method as in 15 wherein an LMS algorithm is used to update all the 

15 

FIRs. 

20. A method as in 16 wherein an LMS algorithm is used to update all the 

20 FIRs - 

21. A method as in 17 wherein an LMS algorithm is used to update all the 

FIRs. 

25 

22. A method as in 18 wherein an LMS algorithm is used to update all the 

FIRs. 



23. A method for equalizing an optical signal, modulated with a digital signal, 
received over an optical channel, the method comprising: 
converting the optical signal into an electrical signal; 
summing the electrical signal with a correction signal; 
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providing the summed signal to a detector; 
detecting the summed signal to produce decisions; 
providing the decisions to a nonlinear channel estimator; and 
estimating the correction signal in the nonlinear channel estimator. 

24. The method of clam 23 wherein estimating the correction signal in the 
nonlinear estimator further comprises: 

accepting the decisions; 

predicting the inter-symbol interference of the channel in a nonlinear channel 
estimator; and 

forming a correction signal from the predicted inter-symbol interference. 

25. The method of claim 24 wherein predicting the inter-symbol interference 
of the channel further comprises: 

providing the decisions to a plurality of Volterra Kernels; and 

summing the output of the plurality Volterra Kernels to form a correction signal. 

26. The method of claim 25 further comprising: 

comparing the predicted inter-symbol interference to inter-symbol interference 
in the electrical signal; and 

updating the Volterra Kernels based on the result. 

27. The method as in claim 26 wherein updating the Volterra Kernels 
comprises using a LMS (Least Means Squared) algorithm to update the Volterra 
Kernels. 
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28. The method of claim 24 wherein predicting the inter-symbol interference 
of the optical channel further comprises: 

5 providing the data decisions as an address into a look up table; 

outputting a value stored in the look up table as the predicted inter-symbol 
interference; 

comparing the predicted inter-symbol interference to the inter-symbol 

1 n 

interference in the electrical signal; and 

updating the value stored in the look up table based on the result. 

29. The method as in claim 28 wherein updating the value stored in the look 

15 

up table comprises using a LMS (Least Means Squared) algorithm. 

30. An apparatus for equalizing a signal received over an optical channel, the 
2Q apparatus comprising: 

an input that accepts an optical signal; 

a converter that converts the optical signal into an electrical signal; 
a summation unit that sums the electrical signal with a correction signal; 
25 a detector that detects the summed signal to produce decisions; and 

a nonlinear channel estimator that estimates the correction signal. 

31. The apparatus of claim 30 wherein the nonlinear estimator further 

30 

ou comprises: 

an input that accepts the decisions; 

an estimating circuit that predicts the inter-symbol interference of the channel; 

and 

35 
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an output that provides a correction signal from the estimated inter-symbol 
interference. 

5 

32. The apparatus of claim 31 wherein estimating circuit that estimates the 
intersymbol interference of the channel further comprises: 

a plurality of Volterra kernels that accept the decisions and produce individual 

10 

lu outputs; and 

a summation unit that sums the individual outputs of the plurality of Volterra 
Kernels to form a correction signal. 

15 

33. The apparatus of claim 32 further comprising: 

a comparator for comparing the predicted inter-symbol interference to the inter- 
symbol interference in the electrical signal; and 
2Q means for updating the Volterra kernels based on the result. 

34. The apparatus as in claim 33 wherein the comparator that compares the 
predicted inter-symbol interference to the inter-symbol interference in the electrical 

25 signal includes a LMS (Least Means Squared) algorithm that compares the predicted 
inter-symbol interference to the inter-symbol interference in the electrical signal. 

35. The apparatus of claim 31 wherein the estimating circuit that estimates 
the intersymbol interference further comprises: 

a look up table which accepts the data decisions as an address into the look up 

table; 

values of the predicted inter-symbol interference stored in the look up table; 
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a subtracter that subtracts the predicted inter-symbol interference from the 
electrical signal to produce a signal substantially free from intersymbol interference; 
5 a second subtracter that subtracts the decision from the substantially inter- 

symbol interference free signal to produce an error; 

and 

means for updating the value stored in the look up table based on the error. 

10 

36. The apparatus as in claim 35 wherein comparing the comparator that 
compares the estimated inter-symbol interference to the inter-symbol interference in the 
electrical signal comprises a LMS (Least Means Squared) algorithm that compares the 

15 

predicted inter-symbol interference to the inter-symbol interference in the electrical 
signal. 

2 q 37. A method for decoding a signal received over an optical channel, the 

method comprising: 

receiving a signal including linear and non linear components; 

estimating, in a non linear channel estimator, the expected values of the received 

25 signal; 

computing the branch metrics based on the expected values of the received 

signal; 

providing the computed branch metrics to a Viterbi decoder; and 

on 

Viterbi decoding the received signal using the branch metrics provided to the 
Viterbi decoder. 

35 
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38. The method of claim 37 wherein estimating, in a non linear channel 
estimator, the expected values of the received signal comprises: 
5 providing the value of the received signal to a Volterra kernel estimator; and 

computing the expected value sent based on the output of the Volterra kernel 
estimator. 

10 39. The method of claim 37 wherein estimating, in a non linear channel 

estimator, the expected values of the received signal comprises: 

providing the value of the received signal as an address to a look up table; and 
looking up the stored value as the actual value transmitted . 

15 

40. An apparatus for decoding a signal received over an optical channel, the 
apparatus comprising: 

2Q a receiver for receiving a signal including linear and non linear components; 

a non linear channel estimator that computes the expected values of the 
received signal; 

a branch metrics computer for computing the branch metrics based on the 
25 expected values of the received signal; 

a Viterbi decoder that accepts the computed branch metrics and 
Viterbi decodes the received signal. 

on 

ou 41 . The apparatus of claim 40 wherein the non linear channel estimator that 

computes the expected values of the received signal comprises a Volterra kernel 
estimator that computes the expected value sent based on the output of the Volterra 
kernel estimator. 

35 
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42. The apparatus of claim 40 wherein the non linear channel estimator that 
computes the expected values of the received signal comprises a look up table that 
5 uses the value of the received signal as an address to look up the stored value as the 
actual value transmitted . 



43. A method for detecting digital data modulated on an optical signal and 
received over an optical channel, the method comprising: 
converting the optical signal to an electrical signal; 
converting the electrical signal to a multibit digital representation; 
estimating distortion introduced in the optical signal by the optical channel; 
compensating the multibit digital representation for the distortion; and 
detecting the digital data from the compensated multibit digital representation. 



44. A method as in claim 43 wherein estimating distortion introduced in the 
optical sig nal by the optical channel comprises estimating in a Volterra Kernel estimator 
the distortion introduced in the optical channel. 



25 45. A method as in claim 43 wherein estimating distortion introduced in the 

optical signal by the optical channel comprises estimating in a lookup table estimator 
the distortion introduced in the optical channel. 



30 



35 



46. An apparatus for detecting digital data modulated on an optical signal and 
received over an optical channel, the apparatus comprising: 

a converter for converting the optical signal to an electrical signal; 
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an analog to digital converter that converts the electrical signal to a multibit digital 
representation; 

5 an estimator that estimates distortion introduced in the optical signal by the 

optical channel; 

a compensator that compensates the multibit digital representation for the 
distortion; and 

1 n 

lu a detector that detects the digital data from the compensated multibit digital 

representation. 

47. A method as in claim 45 wherein estimator that estimates distortion 

15 

introduced in the optical signal comprises a Volterra Kernel estimator. 

48. A method as in claim 45 wherein estimator that estimates distortion 
2Q introduced in the optical signal comprises a lookup table estimator. 

49. An apparatus as in claim 46 wherein the estimator that estimates 
distortion introduced in the optical signal comprises a Volterra Kernel estimator. 

25 

50. An apparatus as in claim 46 wherein estimator that estimates distortion 
introduced in the optical signal comprises a lookup table estimator. 

30 
35 
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